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Abstract 

In this paper we consider the first passage process of a spectrally negative Markov additive 
process (MAP). The law of this process is uniquely characterized by a certain matrix function, 
which plays a crucial role in fluctuation theory. We show how to identify this matrix using the 
theory of Jordan chains associated with analytic matrix functions. Importantly, our result also 
provides us with a technique, which can be used to derive various further identities. We then 
proceed to show how to compute the stationary distribution associated with a one-sided reflected 
Oh ' (at zero) MAP for both the spectrally positive and spectrally negative cases as well as for the two 

f~| . sided reflected Markov-modulated Brownian motion; these results can be interpreted in terms of 

I queues with MAP input. 
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^ ' Keywords: Levy processes; fluctuation theory; Markov additive processes; Markov-modulated Brow- 
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• 1 Introduction 

' Continuous-time Markov additive processes (MAPs) with one-sided jumps have proven to be an im- 
portant modelling tool in various application areas, such as communications networking [24, Ch. 6-7] 
and finance [3, 14]. Over the past decades a vast body of literature has been developed; see for instance 
[1, Ch. XI] for a collection of results. A MAP can be thought of as a Levy process whose Laplace expo- 
nent depends on the state of a (finite-state) Markovian background process (with additional jumps at 
5^ I transition epochs of this background process). It is a non-trivial generalization of the standard Levy 
process, with many analogous properties and characteristics, as well as new mathematical objects 
associated to it, posing new challenges. Any Levy process is characterized by a Laplace exponent 
V'(a); its counterpart for MAPs is the matrix exponent F{a), which is essentially a multi-dimensional 
analogue of ■0(q). 

In this paper we consider the first passage process defined as the first time the process exceeds 
level X. We concentrate on the case of a spectrally negative MAP (that is, all jumps are negative), 
so that the first passage process is a MAP itself. Knowledge of the matrix exponent of this process, 
which we in the sequel denote by the matrix function A(g), is of crucial interest when addressing 
related fiuctuation theory issues. Indeed it can be considered as the multi-dimensional generalization 
of — <I>(g), where ^{q) is the (one-dimensional) right-inverse of V'(a)j as given in [19, Eqn. (3.15)]. Our 
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main result concerns the identification of the matrix function A{q) in terms of the matrix exponent 
F[a) of the original MAP. We provide the Jordan normal form of A(q) relying on the theory of Jordan 
chains associated with analytic matrix functions. 

Importantly, our main result is not only about identification of the matrix exponent of the first 
passage process. We prefer to see our contribution rather as the development of a new technique: the 
theory of analytic matrix functions, combined with the special structure of the Jordan pairs of F(a)—ql 
(with I being the identity matrix), and their relation to the matrix A(g), enables the derivation of a 
set of further identities. These identities, such as (30) and (54), then play an important role in the 
solution of a number of problems related to the reflection of the MAP; here 'reflection' amounts to 
an adaptation of the MAP in order to ensure that the process attains values in a certain subset of 
M only. In this sense, we could reflect at to obtain a process that assumes nonnegative values only 
(which can be interpreted as a queue with infinite buffer capacity), or at both and b > to restrict 
the process to [0,6] (this double reflection is essentially a queue with finite buffer b). In the following 
we discuss in more detail these reflection problems, which we solved using this technique. 

In [4] a martingale associated with the MAP was established, being essentially the multidimensional 
counterpart of the martingale found in [17] for the standard Levy process. In the same paper, various 
situations were considered in which this martingale could be applied. Most notably, attention was 
paid to reflection of a spectrally positive MAP at 0, i.e., a queue fed by a spectrally positive MAP; 
here 'spectrally positive' means that all jumps are positive. For this model the multidimensional 
martingale allowed to reduce the problem of determining the stationary workload to finding various 
constants that are solutions to a system of linear equations. The authors of [4] did not succeed, 
however, in proving that such a system of equations has a unique solution. Also for the situation of 
doubly reflected Markov-modulated Brownian motion, in the following denoted by MMBM, a similar 
complication arose. In the literature, problems of this type were only partially addressed for special 
cases (e.g., see [2, 6, 15, 18]). In our paper we tackle these problems using the technique outlined 
above. 

This paper is organized as follows. Section 2 reviews some main results from analytic matrix 
function theory, while in Section 3 we identify the matrix exponent A(g) by relating the Jordan pairs 
of the matrix functions F{a) — ql and al + A(q) for a fixed q > 0. This result, which is Theorem 3 
and which can be considered as the main contribution of our work, is explicit in the sense that it is 
given in terms of computable quantities associated with F{a). As mentioned above, it in addition 
leads to a technique which can be used to obtain further important identities. This technique is 
discussed in Section 4 and is then applied in Sections 5-8, where we solve a number of open problems 
related to reflected processes. In Section 5 we study spectrally one-sided MAPs reflected at 0. In 
particular, both for spectrally negative and spectrally positive MAP input, we express the steady- 
state workload in terms of quantities related to the matrix exponent A(g) of the first passage process 
of a spectrally negative MAP. The result of Section 5.1 is not new and is here for completeness. In 
Section 5.2 we succeed in solving the (above mentioned) issues that remained open in [4]. In Section 
6 we apply the methodology to identify the stationary distribution of Markov-modulated Brownian 
motion with two reflecting barriers. We provide a full treatment of this model, also for the case of 
asymptotic drift. In Section 7 we identify the so-called scale functions associated with MMBM, 
which is, to our best knowledge, a new result. Yet another demonstration of applicability of our 
technique is given in Section 8, where we present a simple proof of the fact that A{q) is a unique 
solution of a certain matrix integral equation. This result (in different degrees of generality) appears 
in [2, 6, 21, 22, 23, 25], and is commonly considered as the main tool used to numerically identify 
A{q). Some spectral considerations (under the assumption that A(q) has distinct eigenvalues) can be 
found in [2, 6, 22]. Finally, an iterative method to compute A{q) can be found in [5]. 

In order to point out the contribution of our work as precisely as possible, we feel that the following 
comment is important. It should be realized that it is the connection between MAPs and the theory 
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of Jordan chains that enables the most general treatment of the problem. As we mentioned above, 
we do not need to assume that certain systems of equations have a unique solution, and hence we feel 
that from a mathematical perspective our framework is more natural than those used before. One 
could argue, however, that in practical situations the uniqueness requirement will virtually always 
be fulfilled. This concern is valid if one is only concerned with the computation of A{q), but the 
importance of our result becomes apparent when considering applications such as those presented in 
Section 5-8. For example, the special but important case of the MMBM with zero drift immediately 
leads to a non-simple eigenvalue 0. In this case an additional equation associated to the null Jordan 
chain is required to obtain the solution, see (53) and (58). Finally, the proofs of identities such as (30), 
(54), (56) and (59) can be obtained in a routine way using the technique presented in Section 4, which 
we can do only due to the full generality of the main result; this was not possible before. 

The remainder of this section is devoted to the definition of the quantities of interest, with a focus 
on spectrally negative MAPs and their first passage process. 

1.1 Spectrally negative MAP 

A MAP is a bivariate Markov process {X(t), J(t)) defined as follows. Let J(-) be an irreducible 
continuous-time Markov chain with finite state space E = {1, . . . , N}, transition rate matrix Q = {qij) 
and a (unique) stationary distribution tt. For each state i of J(-) let ^i(-) be a Levy process with 
Laplace exponent il!i{a) = log(Ee""'^»(^)). Letting r„ and T„+i be two successive transition epochs of 
J(-), and given that J(-) jumps from state i to state j at T^, we define the additive process X{-) in 
the time interval [T„,T„+i) through 

X{t) = X{Tn-) + Ui; + [X,{t) - X,{Tn)], (1) 

where (Ulj) is a sequence of independent and identically distributed random variables with moment 
generating function 

G'ij(a) =Ee"^i, where C//i = 0, (2) 

describing the jumps at transition epochs. To make the MAP spectrally negative, it is required that 
Ulj < (for all i,j G {1, . . . ,N}) and that Xi{-) is allowed to have only negative jumps (for all 
i G {1, . . . ,N}). As a consequence, the moment generation functions Gij{a) are well defined for 
a > 0. 

A Levy process is called a downward subordinator if it has non-increasing paths a.s. We denote 
the subset of indices of E corresponding to such processes by E^. Let also E^ = E\Ei, = \E^\ and 

= \E+\. It is convenient to assume that E+ = {1, . . . ,iV+}, which we do throughout this work. 
We use and to denote the restrictions of a vector v to the indices from and E^ respectively. 
Finally, in order to exclude trivialities it is assumed that > 0. 

Define the matrix F{a) through 

F{a) = Q o G{a) + diag[V'i(a), . . . , V'iv(a)], (3) 

where G{a) = {Gij(a)); for matrices A and B of the same dimensions we define A o B = (aijbij). 
One can see that in the absence of positive jumps F{a) is analytic on C^''^^ = {a G C : Re(a) > 0}. 
Moreover, it is known that 

E,[e"^W; J(i) = j] := E,[e"^W = (e^(")*),,-, (4) 

cf. [1, Prop. XI.2.2], where Ej(-) denotes expectation given that J(0) = i. We also write E[e"''^(*^; J{t)] 
to denote the matrix with ij-th element given in (4). Hence F{a) can be seen as the multi-dimensional 
analog of a Laplace exponent, defining the law of the MAP. In the following we call F(a)ihe matrix 
exponent of the MAP (X(t), J{t)). 
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An important quantity associated to a MAP is the asymptotic drift: 

K = \im ^EiX{t) = E ^4 ^^(0) + E ^^AjiO) I , (5) 

« \ jy^i / 

which does not depend on the initial state i of J{t) [1, Cor. XI. 2. 7]. Finahy for g > we define 
F'^{a) = F{a) — ql, with I being the identity matrix, which can be seen as the matrix exponent of the 
MAP 'killed' at random time e^: 

E[e"^W ■,t<eg, J{t)] = e(^(")-9i)*, (6) 

where is an exponential random variable of rate q independent of everything else and cq = cx) by 
convention. 

1.2 First Peissage Process 

Define the first passage time over level x > for the (possibly killed) process X{t) as 

Tx = inf{t > : X{t) > x}. (7) 

It is known that on {J{tx) = i} the process {X{t + Tx) — X{tx), J{t + Tx)),t > is independent from 
{X(t), J(t)),t G [0, Tx] and has the same law as the original process under Pj. Therefore, in the absence 
of positive jumps the time-changed process J{tx) is a time-homogeneous Markov process and hence 
is a Markov chain. Letting {d} be an absorbing state corresponding to J(oo), we note that J{tx) 
lives on E^^- U {d}, because X{t) can not hit new maximum when J{t) is in a state corresponding to 
a downward subordinator; see also [20]. Let A(g) be the x A^_|_ dimensional transition rate matrix 
of J{tx) restricted to E^, that is 

nJirx) = j, Tx<eg\ J(ro) = i) = (e^^^^")^,-, where i,j G E+. (8) 

It is easy to see that in the absence of positive jumps the first passage process {tx, J{tx)),x > is a 
MAP itself. Moreover, 

E[e-i^-;J{Tx) = j I J(ro) = i] = P(J(t^) = j,r^ < e, | J(ro) = i) = (e^^'')^)^,-, 

so that A{q) is the matrix exponent of (the negative of) the first passage process. This interpretation, 

however, is not used in the rest of this paper. 

Another matrix of interest is x A_|_ matrix Il{q) defined by 

U{q)ij = Pi( J(ro) = j, To < eg), where i e E and j e E+. (9) 

This matrix specifics initial distributions of the time-changed Markov chain J{tx)- Note also that 
n(g) restricted to the rows in E^ is the identity matrix, because tq = a.s. when J(0) G E^ [19, 
Thm. 6.5]. We note that the case of g = is a special case corresponding to no killing. In order to 
simplify notation we often write A and 11 instead of A(0) and 11(0). 

It is noted that if g > or g = 0, k < then A(g) is a defective transition rate matrix: A(g)l_|_ < 0+, 
with at least one strict inequality. If, however, k > 0, then A is a non-defective transition rate matrix: 
Al_|_ = 0+; also ni_|_ = 1. These statements follow trivially from [1, Prop. XI.2.10]. Finally, note 
that A is an irreducible matrix, because so is Q. Hence if A is non-defective then by Perron-Frobenius 
theory [1, Thm. 1.6.5] the eigenvalue is simple, because it is the eigenvalue with maximal real part. 

It is instructive to consider the 'degenerate' MAP, i.e., the one with dimension = 1. Such a 
MAP is just a Levy process, and A{q) = — $(g), where <&(gr) is the right-inverse of ip{a), a > 0. Note 
also that A being non-defective (and hence singular) corresponds to $(0) = 0. 



4 



2 Preliminaries 

In this section we review some basic facts from analytic matrix function theory. Let A(z) be an 
analytic matrix function (n x n dimensional), defined on some domain D C C, where it is assumed 
that det(^(2:)) is not identically zero on this domain. For any X & D we can write 

oo ^ 

A{z) = J2-^A^H^)iz-Xy, (10) 
1=0 ^• 

where A(*)(A) denotes the z-th derivative of A{z) at A. We say that A is an eigenvalue of A{z) if 
det{A{X)) = 0. 

Definition 1. We say that vectors vq, . . . ,Vr-i G C" with vq ^ form a Jordan chain of A{z) 
corresponding to the eigenvalue A if 



j2^A(^Wvj-i = 0, j = 0,...,r-l. (11) 

1=0 ^■ 

Note that this definition is a generalization of the well-known notion of a Jordan chain for a square 
matrix A. In this classical case A{z) = zl — A, and (11) reduces to 

Avo = Xvo, Avi=Xvi+Vo, AVr-l = XVr-l + Vr-2- (12) 

The following result is well known [11] and is an immediate consequence of (12). 

Proposition 1. Let i>o, • • • , I'r-i be a Jordan chain of A{z) corresponding to the eigenvalue X, and 
let C{z) be m X n dimensional matrix. If B{z) = C{z)A{z) is r — 1 times differentiable at X, then 



J 1 

^-i?W(A)t;,_, = 0, i = 0,...,r-l. (13) 

1=0 

Note that if B{z) is a square matrix then Vq,... , Vr-i is a Jordan chain of B{z) corresponding to 
the eigenvalue A. It is, however, not required that C{z) and B{z) be square matrices. 

Let m be the multiplicity of A as a zero of det(^(z)) and p be the dimension of the null space 
of ^(A) = Aq. It is known, see e.g. [11], that there exists a canonical system of Jordan chains 
corresponding to A 

vf\vf\...,v^:^l,, k = l,...,p, (14) 

such that the vectors Vq^^ , • • • , v^^^ form the basis of the null space of Aq and Yli=i "^i — We write 
such a canonical system of Jordan chains in matrix form: 

v = [v^\v^\...,v^^l,,...,v^^\v^\...,v^^^_,], r = diag[rw,...,r(^)], (15) 

where F^'^ is the Jordan block of size rj x rj with eigenvalue A, i.e. a square matrix having zeros 
everywhere except along the diagonal, whose elements are equal to A, and the superdiagonal, whose 
elements are equal to 1. 

Definition 2. A pair of matrices (V, F) given by (15) is called a Jordan pair of A{z) corresponding 
to the eigenvalue A. 
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We note that, unhke in the classical case, the vectors forming a Jordan chain are not necessarily 
linearly independent; furthermore a Jordan chain may contain a null vector. 

We conclude this section with a result on entire functions of matrices defined through 

OO -. 

f{M) = Y,^f^'\0)M\ (16) 

i=o 

for an entire function / : C — )■ C and a square matrix M. The next lemma will be important for 
applications. 

Lemma 2. Let f : C C be an entire function and let F be a Jordan block of size k with A on 
the diagonal, then for an arbitrary set of vectors Vq, . . . ,Vk^i the {j + l)-st column of the matrix 
[vo,...,Vk-i]f{T) equals 

i2l^f^\^>j-i^ (17) 

i=0 

where j = 0, . . . , k — 1. 

Proof. Immediate from [7, Thm. 6.6]. □ 



3 Jordan Normal Form of A(q) 

In this section we consider a spectrally negative MAP {X{t),J{t)) with matrix exponent F{a) and 
asymptotic drift k. Let Ai,...,Afc be the eigenvalues of F'^{a), to be understood as the zeros of 
det(F'?(Q;)), for a given g > 0, in its region of analyticity C^'^^*'. Let {Vi,Ti) be a Jordan pair 
corresponding to the eigenvalue Aj. Define the matrices V and F in the following way: 



V= [Vi,...,Vk] 

r= diag[ri,...,rfe] 

V= [l,Vi,...,Vk] 

T= diag[o,ri,...,rfc] 



if 5 > or g = 0, K < 0; 



if g = 0, K > 0. 



(18) 



and let the matrices V+ and be the restrictions of the matrix V to the rows corresponding to 
and respectively. 

Theorem 3. It holds that T and are iV+ x N^- dimensional matrices, V+ is invertible, and 

A{q) = -V+TV~\ U{q) = VV~\ (19) 

We start by establishing a lemma, which can be considered as a weak analog of Thm. 3. 
Lemma 4. Ifv^, . . . , v'^~^ is a Jordan chain of F'^{a) corresponding to the eigenvalue A G (CR-e>o fi^^^ 



for i 



0,...,r 



v'^, . . . ,v^_^_ is a Jordan chain of al + A{q) corresponding to the eigenvalue a = X and Il{q)v]^ 



1. 



Proof. It is known from [4, Theorem 2.1] or by direct applying the Dynkin's formula, see [8], that for 



Ma{t) 



IJO 



ds 



F(a) + e;-e"^We: 



is a row vector valued zero mean martingale under the probability measure ¥k, where ' ' ' denotes the 
transposition operation. Apply the optional sampling theorem to Ma(-) with the finite stopping time 



t ATx ACq and note that 



= q^^ 



I 



tATxACn 



ds 
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to obtain 

C{a)Fi{a) = B{a), (20) 

where 



4. 



Equation (20) can be seen as the Wiener-Hopf factorization for the killed MAP {X{t), J(t)), see also 
[16]. 

Noting that X(-) < x on [0, Tx] and using usual dominated convergence argument we conclude that 
B(a) is infinitely differentiable in a G C^«>°. Apply Prop. 1 to (20) to see that for all j = 0, . . . , r — 1 
the following holds true: 



v^-' - e'f,v^ = 



Letting t — )■ 00 we obtain 

^x'e^-Fk{J{rx),Tx < eg)v^-' - e'^v^ = 0, (21) 



where Pfc( J(ra;), < e^) denotes a row vector with ^-th element given by ¥k{J{Tx) = £,Tx < Sq). Note 
that the case when q = and VkiTx = 00) > should be treated with care. In this case k < and 
thus lim^^oo -^(i) = —00 a.s. [1, Prop. XI. 2. 10], so the above limit is still valid. 

Considering (21) for all k € E and choosing x = we indeed obtain Il{q)v-!^ = If, however, we 
pick k G then 

^ 1 *g(An+A(g))a.^i-i _ ^j^ ^ (22) 

Take the right derivative in a; at of both sides to see that 

(AI + A(5))< + <-^ = 0+, (23) 

which shows that i;^}^, . . . , is a Jordan chain of al + K{q) corresponding to the eigenvalue A. □ 

We are now ready to give a proof of our main result, Thm. 3. 

Proof, of Theorem 3 Lemma 4 states that v*^, . . . jf^T^ is a classical Jordan chain of the matrix 
— A(g). Recall that if g = 0, k > then A(g)l+ = 0+ and n(g)l+ = 1. Therefore the columns of 
are linearly independent [10, Prop. 1.3.4] and 

-K{q)V+ = F+r, Ii{q)V+ = V. (24) 

Consider the case when g > 0. Now [13, Thm. 1] states that det(F''(a)) has zeros (counting 
multiplicities) in C^*^^'^; see also [13, Rem. 1.2], so the matrices V+ and T are of size Nj^ x Nj^ by 
construction (18). Note there is one-to-one correspondence between the zeros of det(F*(Q!)) in C^^^° 
and the eigenvalues of — A(g) when g > 0. 

Assume now that g = 0. We only need to show that det(F(a)) has — 1|k>o} zeros (counting 
multiplicities) in C^^^^. Pick a sequence of g^ converging to and consider a sequence of matrix 
exponents F'^"{a) = F{a) — gnl and transition rate matrices A(g„). Prom (8) it follows that e^^*") — )■ 
e^, hence the eigenvalues of A(g„) converge to the eigenvalues of A (preserving multiplicities) as 
n oo. Moreover, all the eigenvalues of A have negative real part except a simple one at if k > 0. 
The above mentioned one-to-one correspondence and the convergence statement of [13, Thm. 10] 
conclude the proof. □ 
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The above proof strengthens [13, Thm. 2]; we remove the assumption that k is non-zero and finite. 
Corollary 5. It holds that det{F{a)) has — 1{k>o} zeros (counting multiplicities) in C^^^°. 

4 The Technique 

As an important remark, Thm 3 can be used as the basis for a technique, which allows one to obtain 
various useful identities. This technique is used in Sections 5.2, Section 6, Section 7 and can be 
recovered with some modifications in Section 8. In short, it consists of the following steps: 

• use a martingale argument to arrive at an initial equation involving the unknown quantities and 

F{a), 

• use the properties of Jordan chains such as Prop. 1 and Lemma 2 to rewrite the initial equation 
in terms of {V, F), 

• use the special structure of {V, F), such as invertibility of V, to simplify the equation, 

• eliminate the Jordan pair by introducing A and U using Thm. 3 to recover the probabilistic 
interpretation of the involved matrices and claim uniqueness of the solution. 

It is noted that our technique can be seen as the extension of the ideas known as 'martingale calcu- 
lations for MAPs' [1, Ch. XI, 4a] to its final and general form. It is important that no assumptions 
about the number and simplicity of the eigenvalues are needed. Moreover, using this technique based 
on generalized Jordan chains, one can eliminate Jordan pairs from the solution and claim uniqueness. 
The procedure is illustrated in the next sections. 



5 One-sided Reflection Problems 



The first illustration of our technique concerns the stationary process of the reflection of spectrally 
one-sided MAPs. For a given MAP {X{t), J{t)) the reflected process iW{t), J{t)) is defined through 

W{t) = X{t)- mi X{s) AO; (25) 

0<s<t 

we say that W{t) is the (single-sided) reflection of X{t) at 0. It is well known that this process has 
a unique stationary distribution if the asymptotic drift k is negative, which wc assume in the sequel. 
Let a pair of random variables (W, J) have the stationary distribution of {W{t), J{t)), and denote the 
all-time maximum attained by X{t) through X = supj>o -'^(t). It is an immediate consequence of [1, 
Prop. XI.2.11] that 

{W \ J = i) and (^X \ J(0) = have the same distribution, (26) 

where {X{t), J{t)) is the time-reversed process characterized by the matrix exponent F{a) = A^^F(q)'At 
where for any given vector x we define A^. = diag[xi, . . . , xjv]. In the following we identify the distri- 
bution of the random variables appearing in (26) for two important classes: spectrally negative MAPs 
and spectrally positive MAPs. 
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5.1 Spectrally negative MAP 

Let {X{t), J{t)) be a spectrally negative MAP with negative asymptotic drift: k < 0. It is crucial to 
observe that (X | J(0) = i) is the life-time of J{tx), thus it has a phase-type distribution [1, Section 
III.4] with transition rate matrix A, exit vector — A1+ and initial distribution given by e^II. It is 
noted that if i G E^, then X{t) never hits the interval (0, cx)) with probability Pi(ro = oo), hence 
(X I J(0) = i) has a mass at zero. 

The time-reversed process is again a spectrally negative MAP with negative asymptotic drift and 
being the set of indices of associated downward subordinators. Thus, with self-evident notation, 
the vector of densities of (W^ | J) at a; > is given by 

p{x) = ne^^(-Al+). (27) 

We conclude that we can express the distribution of the stationary workload in terms of quantities 
that follow uniquely from Thm. 3. 

5.2 Spectrally positive MAP 

Let {Y{t), J{t)) be a spectrally positive MAP with negative asymptotic drift. Define X{t) = —Y{t) 
and note that {X{t), J{t)) is a spectrally negative MAP with positive asymptotic drift: k > 0. Let 
F{a) and E^ U E^ be the matrix exponent and the partition of the state space of the latter process. 
The Laplace-Stieltjes transform of {W, J) is identified in [4] up to a vector £ of unknown constants: 

E[e-"^e'j] = a£'F{a)-\ (28) 

where £^ = 0, £'l = k. 

We determine the vector £j^ as follows. Let . . . ,v'^~^ be a Jordan chain of F{a) associated 
with an eigenvalue A G C^'^^''. Right multiply both sides of Eqn. (28) by F{a) and use Prop. 1 to see 
that \£'v^ + £'v^~^ = for all j = 0, . . . , r — 1; where = 0. It trivially follows that £'V = ne'i or 
equivalently 

(£+)' = Ke[{V+r\ (29) 
It is easy to verify now using Thm. 3 that 

£+ = KTTA, (30) 

where tta is the stationary distribution of A, cf. [6, Lemma 2.2]. Observe that we again succeeded in 
expressing the distribution of the stationary workload in terms of quantities that can be determined 
by applying Thm. 3. 

6 Two-sided Reflection of MMBM 

In this section we consider a Markov-modulated Brownian motion {X{t),J{t)) of dimension A^. In 
this case the matrix exponent (3) has the special form of a matrix polynomial of second order, that is, 

F{a) = ^ ^ (31) 

where G M, cTj > for i = 1, A^. 

We are interested in a two-sided refiection [4] of (X(t),J{t)) with and 6 > being lower and 
upper barriers respectively. This reflected process can be interpreted as a workload process of a queue 



9 



fed by MMBM, where b is the capacity of the buffer. Let the pair of random variables {W, J) have 
the stationary distribution of this process. It is shown in [4] that 

E [e"^e'j] • F{a) = a(e"''u' - £'), (32) 

where u and £ are column vectors of unknown constants. In the following we show how to compute 
these constants. This result completes the investigation on MMBM contained in [4] and extends the 
previous works [15, 18, 25]. 

In order to uniquely characterize the vectors u and £ we exploit the special structure of MMBM. 
As MMBM is a continuous process almost surely, both {X{t),J{t)) and {—X{t), J{t)) are spectrally 
negative MAPs. Regarding the downward subordinators of {X{t),J{t)), let the sets and E^, 
and the cardinalities and be defined as before. The downward subordinators of the process 
{—X{t), J(t)) correspond to the upward subordinators of the process {X{t),J{t)). Denote the subset 
of states of E associated to such processes by E^. Similarly we denote by E^ the set of the states 
where the process {—X(t), J{t)) can reach positive records. We note that it is possible to have that 
E^ D E^ ^ 0, as the intersection is given by the states where the process stays constant. Finally the 
cardinalities of E- and E^ are denoted through and N-^ respectively. 

Let Ao, . . . , Afe be the zeros of det(F(Q;)) in C with Aq = 0. Let also {Vi,Ti) be a Jordan pair of 
F{a) corresponding to Aj. Define 

V = {Vo,...,Vk), r = diag(ro,...,rfc). (33) 

Theorem 6. The unknown vectors u and I in Eqn. (32) can be uniquely identified in the following 
way: u^ = and £^ = while the vectors ti+ and £- are the solutions of the system of equations 

(V,0( ^ly^ ) =(fe',0,...,0), (34) 

where 

k' = .'(Aj-Al)(^l) (35) 

is a vector with dimension equal to the multiplicity of the root of det{F{a)). 

Before we give a proof of Thm. 6 we provide some comments on the structure of the pair (V, T). The 
following simple lemma identifies the number of zeros of det(F(a)) in different parts of the complex 
plane, see also [15] for the case when k ^ 0. 

Lemma 7. det(F(a)) has — -^{«;>o} zeros in C^^^°, — 1{k<o} zeros in C^^^° and a zero at 
of multiplicity 1 + 1[k=o} ■ 

Proof. It is easy to see that det(F(a)) is a polynomial of degree + N^, hence the total number of 
zeros of det{F{a)) in C counting their multiplicities is N^-\-N-. On the other hand Corollary 5 states 
that det(F(Q!)) has — 1{k>o} zeros in C^*^^" and ~ 1{k<o} zeros in C^'^^", because F{—a) is 
the matrix exponent of a spectrally negative process {—X{t),J{t)) having asymptotic drift —k. The 
result follows from [13], where it is shown that det{F{a)) does not have zeros on the imaginary axis 
which are distinct from 0. □ 

Next we note that the null-space of F{0) = Q is spanned by 1, because Q is an irreducible 
transition rate matrix. Moreover, scaling matrix V amounts to scaling both sides of Eqn. (34) by the 
same constant, hence we can assume that the first vector in Vq, and thus also in F, is 1. If «; = then 
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according to Lemma 7 the zero Ag has multiphcity 2, in which case we have that Fq is a 2 x 2 matrix, 
and Vq an iV X 2 matrix, given by 

ro=(o J)' ^o = (l,^), (36) 

where the vector h solves 

F{0)h + F'{0)l = Qh + Aal = O (37) 
due to (11). Since Tr'A^l equals the asymptotic drift k, Eqn. (35) reduces to 

. / _ f ^ , if At / 

" -\ (0,7r'(iA2l + A„/i)), if/^ = 0. ^^^^ 
We now prove the following technical lemma that further specifies k in the case «; = . 
Lemma 8. If k = 0, then Vq = (1, h) and 

bu'l + {u' - £')h = 7r'(^A^l + Aah) 0. (39) 

Proof. Differentiating Eqn. (32) at and right multiplying by h, we obtain the identity 

{u' - i')h = ¥.[We'j]Qh + ¥.[e'j]Aah = -E[We'j]Aal + E[e'j]Aah, (40) 

where the second equality follows from (37). Differentiating Eqn. (32) twice at and multiplying by 
1, we find 

bu'l = E[T^e'^]A„l + E[e'j]^A^l, (41) 

which summed with the previous equation gives (39). We conclude the proof by showing that the 
resulting expression cannot equal 0. 

It is known, see [9], that the maximum length of a Jordan chain cannot exceed the algebraic 
multiplicity of the associated eigenvalue. We therefore have that for any vector v it holds that 

^All + Aah + Qv^O, (42) 

because otherwise {l,h,v) would be a Jordan chain associated with Aq, which has multiplicity 2 

(Lemma 7). This implies that ^A^ 1 + A^ h is not in the column space of Q, which is known to be 
of dimension A'^ — 1, because Q is irreducible. Moreover, n'Q = 0', thus 7r'(iA^ 1 + A^ h) ^ 0. □ 

We now construct pairs (V^ ,T^) and {V~ ,r~) in the same way as we constructed {V,T), but we 
use only those {Vi,Ti) for which Aj G ([;;R-e>o ^^^^ ^. ^ (j-^Rc<o^ respectively. Moreover, an additional 
pair (1, 0) is used (as the first pair) in the construction of {V^,T^) and {V~,T^) if k > and k <0, 
respectively. Note that in view of Lemma 7 the matrix has exactly N± columns. 

In the following we use and 11^ to denote the matrices associated to the first passage process of 
(±X(i), J{t)), and defined according to Eqns. (8) and (9). Next we present a consequence of Thm. 3. 



Lemma 9. The following holds 



A+ = -i/+r+(F+)-i n+ = y+(y+)-i 
A- = vzr-{vi)-^ n- = v-{vz)-^. 



Proof. The first line is immediate from Thm. 3 and the second line follows by noting that if v^, . . . , v^~^ 
is a Jordan chain of F{a) then v^, —v^, . . . , { — lY~^v'^~^ is a Jordan chain of F(—a). Lemma 4 applied 
to the process {—X{t), J{t)) entails that (— AI + A~)vi_ — ^ = 0, where A is a zero of det{F{a)) in 

CRe<0_ jjg^gg ^-y- ^ Vir-. □ 
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We now proceed with the proof of Thm. 6. 

Proof, of Theorem 6 The proofs of the facts that wj^ = and £^ = and, moreover, {u' — £')1 = 
Tr'Aal = K were already given in [4]. The rest of the proof is spht into two steps. First we show that 
{u'_^,£'_) solves (34), and then we show that the solution is unique. 
Step 1: Lemma 2 and Prop. 1 applied to Eqn. (32) imply 

uVe^^r - £'VT = 0'. (44) 

Let r be the matrix F with Jordan block Fq replaced with I. Suppose first that k 7^ 0. Then 
(Vb,Fo) = (1,0) and so (44) can be rewritten as 

u'Ve^^t - £'vt = ([u' - £']1, 0, . . . , 0). (45) 

Multiply by F"^ from the right to obtain (34). Supposing that k = 0, we have that adding 

hVo / 1 -1 \ / 1 -1 



k=u%e-o^^ 1 , ) (46) 

to the first two elements of the vectors appearing on the both sides of (44) , leads to 

uVe^^f - £.'vt = (fe', 0, . . . , 0). (47) 

To complete Step 1 it is now enough to show that k = k. A simple computation reveals that 
k' = u'(l, (6 - 1)1 + h) - £'{1, -l + h) = (0, bu'l + (u' - £')h), where we used that (u' -£')! = k = 0. 
Use Lemma 8 and (38) to see that k = k. 

Step 2 (uniqueness): Without loss of generality we assume that «; > 0. It is easy to see that {u'_^,£'_) 
solves (34) if and only if 

V+e'"^^ Vle'"^- 



'^y- )=^e[ (48) 

and, in addition when k = Eqn. (39) holds true because of the construction of the matrices V"^ and 
F='= . Note also that we can right multiply both sides of the above display by the same matrix to obtain 

(«V, -£'-) I ../„t,r. 1 = ( ? ) ■ (49) 




Lemma 9 shows that 



(50) 



so we obtain 

Theorem 3 states that V^ and VI are invertible matrices. Moreover, n^e^^^ and H'e^^ are irre- 
ducible transition probability matrices, so the first matrix on the right hand side of (51), call it M, is 
an irreducible non- negative matrix, which is non-strictly diagonally dominant. If k > 0, then Il^j^e''^ 
is sub-stochastic, which implies that M is irreducibly diagonally dominant and hence invertible [12]. 
If K = 0, then M has a simple eigenvalue at by Perron-Probenius, so 
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determines the vector (u^, —'^'-) up to a scalar, which is then identified using (39): 

K,-^'-) ( ^t''^ ) = ^\^ah+\l^ll\ (53) 

which is non-zero by Lemma 8. □ 

Finally, we state a corollary, which identifies (in the case of non-zero asymptotic drift) vectors tt+ 
and £_ in terms of matrices A='= and 11='=. We believe that there should exist a direct probabilistic 
argument leading to this identity. Moreover, it is interesting to investigate if such a result holds in 
the case of countably infinite state space E. 

Corollary 10. It holds that 



K.-^'-)| nv^. \ = 0' = (54, 

K(0'+,7r^_), tfK<0 



where 7r^± is the unique stationary distribution of A^, which is well-defined if k^Q. 
Proof. Assume that k > 0. Prom the above proof we know that 

Hence it is enough to check that 77^+ = e'^ (Ffi")"-'^, which is immediate in view of Thm. 3. The case 
of «; < is symmetric, and the case of k = is trivial. □ 

7 The Scale Functions Associated to MMBM 

The third application of our technique focuses on so-called scale functions associated to MMBM. Fix 

non-negative numbers a and 6, which are not simultaneously 0, and let t~ = inf{t > : X(t) < —x} 
be the first passage over x of the process —X{t). We consider the following matrices 

C(a, h) = E[e-«-- T„ < r-, J(t„)] andL>(a, h) = E[e-i^^ ; < t„, J(t-)] 

having dimensions N x A'^"'" and A'^ x A^~ respectively. These matrices are in fact generalizations of 
the scale functions in the terminology of the theory of Levy processes. 
Using the strong Markov property we write 

C{a,b) = E[e-«^«;J(ra)] -E[e-''^";T^- <ra,J(Ta)] 

= E[e-«-- J(r,)] - D{a, 6)E[e-'?^'^+''; J(r„+fe)], 

where under the first expectation it is implicit that Ta < oo. Thus we get 

C{a,b) = n+e'^^^ -L»(a,6)nle("+^)^^ (56) 
D{a,b) = U'e^^' -C{a,b)U-e^''+^^^~ , 

where and A='= should be read as Ii^{q) and A^{q). The dependence on q is dropped for notational 
simplicity. Similarly as in the proof of Thm. 6 one readily sees that these equations determine the 
scale functions uniquely unless q = and k = 0, in which case one additional equation is required. 
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In the following we show how our technique can be applied here to recover this result, as well as the 
missing equality in the case of g = 0, k = 0. 

Pick an arbitrary eigenvalue A of F{a) — ql and a corresponding Jordan chain Vq,... , w^-i- Fol- 
lowing the same steps as in the proof of Lemma 4, but using t = Ta f\ instead of Tx we obtain 



J 1 r -, 



i=Q 



which further reduces to 

3 



i=0 



-v^ =0. 



A simple observation presented in Lemma 2 shows that 

C{a, 6)F+e"^ + D{a, 6)y_e-^^ = V, (57) 

where (F, V) is a Jordan pair corresponding to F{a) — ql. 

Restricting ourselves to the Jordan pair r+) and multiplying both sides of (57) from the right 
by e~"'^^V^ ^ we obtain 

C{a,b) = y+e-«r+F+~^ - L'(a,6)y+e-('^+^)r+F+~\ 

Finally, application of Lemma 9 results in the first equation of (56), and the second is obtained 
restricting ourselves to (V~,r~). In the case q = 0, k = the above procedure results in the lost of 
the equation associated to the null Jordan chain {l,h). Simple computations show that this equation 
is 

C{a, b){al+ + h+) + D{a, 6)(-61_ + h-) = h, (58) 

which can be shown to be linearly independent of the rest using the idea from the proof of Thm. 6. 
In conclusion, note that equation (57) has a number of advantages over equation (56). It is simpler, 
easier to use in computations, and, moreover, it has always a unique solution. 



8 Matrix Integral Equation 

In this section we demonstrate how our technique can be used to show in a simple way that A{q) is a 
unique solution of a certain matrix integral equation. This equation appears in [2, 6, 21, 22, 23, 25] 
and is commonly considered as the main tool in numerically computing A{q). Throughout this section 
it is assumed that iV+ = N. We use the following notation 

Fi{M) = AaM + lAlM^+ r A,(da;)(e^--I-Ma;l{,>_i}) 

+ Qo G(dx)e^^ - ql (59) 

J —oo 

where (aj, (jj, Mj(dx)) are the Levy triplets corresponding to the Levy processes Xi{-) and Gij{dx) is 
the distribution of Uij and M is any given square matrix of size N. 

Define to be a set of all x matrices Q, such that Q is a transition rate matrix of an 
irreducible Markov chain. Let also {Mo,M.i} be a partition of M. into the sets of defective and 
non-defective matrices respectively. 
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Theorem 11. A(g) is the unique solution of F^{—M) = O, where M G Mi and i = -Z{5=o,k>o}- 

Proof. In the proof we drop the superscript q to simphfy notation. Let —M = VVV~^ be a Jordan 
decomposition of the matrix —M. Let also t^o, • • • jt'r-i be the columns of V corresponding to some 
Jordan block of size r and eigenvalue A. Note that A G C^''^" or A = in which case it must be simple, 
because M G M.. Right multiply (59) by F, note that g{—M) = Vg{r)V~^ for an entire function 
5 : C — >■ C, and finally use Lemma 2 to see that the column of F{—M)V corresponding to Vj equals 

5]iF»(A)t;,_„ (60) 

1=0 

where we also used the fact that differentiation of F(a) at A, Re(A) > can be done under the integral 
signs and no differentiation is needed for a simple eigenvalue A = if such exists. 

If M = A, then the matrices V and F can be chosen as in (18). Hence (60) becomes 0, because 
vq, . . . ,Vr-i is a Jordan chain of F{a), sec (11). But V is an invertible matrix, so that F{—A) = O. 

Suppose now that F{—M) = O and M G A^i. Then the vectors Vq, . . . ,Vr-i form a Jordan 
chain of F{a) corresponding to an eigenvalue A G C^''^^ or A = 0. Finally, use Lemma 4 to see that 
AV = -Vr, and hence we have M = A. □ 
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